The Turing Ratio: Metrics For Open-ended Tasks

نویسندگان

  • Hassan Masum
  • Steffen Christensen
  • Franz Oppacher
چکیده

The Turing Test is of limited use for programs falling far short of human performance levels. We suggest an extension of Turing’s idea to a more differentiated measure the "Turing Ratio" which provides a framework for comparing both human and algorithmic task performance. Games provide an example of the concepts. It is argued that evolutionary computation is a key method for amplifying human intelligence, an assertion which future scientists can empirically decide through measuring Turing Ratios and considering task breadth, prior knowledge, and time series of the measures.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Turing Ratio: A Framework for Open-Ended Task Metrics

The Turing Test is of limited use for entities differing substantially from human performance levels. We suggest an extension of Turing’s idea to a more differentiated measure the "Turing Ratio" which provides a framework for comparing human and algorithmic task performance, up to and beyond human performance levels. Games and talent levels derived from pairwise comparisons provide examples of ...

متن کامل

Hard to Cheat: A Turing Test based on Answering Questions about Images

Progress in language and image understanding by machines has sparkled the interest of the research community in more open-ended, holistic tasks, and refueled an old AI dream of building intelligent machines. We discuss a few prominent challenges that characterize such holistic tasks and argue for “question answering about images” as a particular appealing instance of such a holistic task. In pa...

متن کامل

Four Steps Toward Open-Ended Evolution

In 1998, Bedau et al. de ned a set of metrics for characterizing the long-term evolutionary dynamics of a system. They argued that no known arti cial system demonstrates the unbounded evolutionary activity observed in the fossil record. In response we have developed a series of toy models that approach and eventually succeed in demonstrating unbounded evolutionary activity. The underwhelming su...

متن کامل

Information literacy in public libraries from the perspective of public libraries’ policymakers; an exploratory study

Purpose: The present paper aims to conduct an exploratory study on the status of information literacy in upstream documents and curriculums of Iran public libraries institutions for public libraries. Methodology: This is a developmental exploratory-qualitative study in terms of purpose. Research data were collected using in-depth, semi-structured interviews with policymakers and officials of p...

متن کامل

The Effects of Collaborative Translation Task on the Apology Speech Act Production of Iranian EFL Learners

The present study aims to investigate the relative effectiveness of different types of pragmatic instruction including two collaborative translation tasks and two structured input tasks with and without explicit pragmatic instruction on the production of apologetic utterances by low-intermediate EFL learners. One hundred and fifty university students in four experimental groups and one control ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2002